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User cooperation although improves performance of wireless systems, it requires incentives for the potential 
cooperating nodes that act as relays to spend their energy. Moreover, these potential relays are better informed than 
the source about their transmission costs, which depend on the exact channel conditions on their relay-destination 
links. This results in asymmetry of available information between the source and the relays. In this paper, we use 
contract theory to tackle the problem of relay selection under asymmetric information in OFDM-based cooperative 
wireless systems. We first design incentive compatible offers/contracts, consisting of a menu of payments and desired 
signal-to-noise-ratios (SNR)s at the destination and then the source broadcasts this menu to nearby mobile nodes. 
Once the source is informed about the contracts that the potential relays are willing to accept in each subcarrier, the 
problem of relay selection in each subcarrier while maximizing the capacity under a budget constraint is shown to be 
a nonlinear non-separable knapsack problem which is therefore solved heuristically. We compare the performance 
of our overall mechanism and the heuristic solution with a simple relay selection scheme and selected numerical 

•i-H 

results showed that our solution performs better and is close to optimal. The overall mechanism introduced in 
this paper is simple to implement, requires limited interaction with potential relays and hence requires minimal 
signalling overhead. 
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I. Introduction 

Relay-assisted cooperation in wireless networks plays a key role in improving the overall efficiency 
of wireless networks by improving the system throughput, energy efficiency, spectrum usage, coverage, 
channel reliability and network cost reduction via spatial multiplexing and achieving diversity gains. Relay- 
based cellular network architectures have also been considered for next generation wireless systems such 
as 3 GPP Long Term Evolution (LTE) and IEEE 802. 16j mobile WiMAX (T), @. 

Cooperation via relays can potentially assist a source node by forwarding its data to the destination 
either by amplify-and-forward (AF) or by decode-and-forward (DF) relay protocols. This cooperation can 
be achieved either by installing fixed relays within the network coverage area or by making the other 
mobile nodes act as relays. The latter scenario also known as user cooperation is gaining attention, because 
of the minimal changes required in existing infrastructure and has been shown to not only increase the 
data rates but also to make the achievable rates less sensitive to channel variations (3), Q. While user 
cooperation eliminates the cost of installing additional relay nodes, it increases the complexity of the 
overall system because of several reasons. First, various dynamic resource allocation algorithms require 
near complete channel state information (CSI) from potential users assisting as relays. In absence of this 
information, it is a challenge to design algorithms that dynamically select mobile users as potential relays 
[[5j. Most relay selection algorithms for cooperative networks assume complete CSI (6j, [[7J, however, 
this information is private to mobile users and they may not be willing to share this information causing 
asymmetry of available information between the source mobile user and the potential relays. Secondly, 
user cooperation poses a logistic challenge because the increased rate of one user comes at the expense 
of consumption of the limited resources of the relaying user (e.g. battery, power, bandwidth etc.). The 
potential relaying users are usually selfish nodes and could belong to different network entities/operators 
and hence may not be willing to cooperate without any additional incentive. While relay selection with 
partial CSI have been explored by several authors e.g. (8), J9), no incentive-based mechanisms has been 
considered in these and related works. To tackle this problem, game-theoretic models have generally 
been suggested for cooperative systems that are either reputation-based, resource exchange-based, or 



pricing based |T0j references therein]. However, there are still many challenges in applying game theoretic 
solutions to cooperative systems such as investigating existence, uniqueness, computation and efficiency of 
Nash Equilibrium, as well as addressing signalling overheads |10). Moreover, to the best of our knowledge, 
the problem of relay selection under asymmetric information together with incentive-based mechanisms 



for multi-carrier systems, have not yet been studied. The objective of this paper is to address this problem 
with simple pricing-based incentive mechanisms with minimal signalling overheads. 

As we discussed above, in this paper we address the problem of relay selection under asymmetric 
information with incentive mechanisms for Orthogonal Frequency Division Multiplexing (OFDM) based 
multi-carrier wireless systems. We use a simple principal-agent model from microeconomics for source 



and relay, where source acts as the principal and relay is an agent [11]. In such a model, the bargaining 
power is kept with the principal, and the agent can either accept or decline an offer proposed by the 
principal. Such a model reduces the interaction needed between a source and a relay, and only the users 
willing to relay can participate. These offers or contracts proposed to relays are in the form of a menu of 
renumeration or monetary transfers for a specified service in each subcarrier, which in this paper is taken 
as desired signal-to-noise ratio (SNR) at destination. Assuming that the source has limited information 
about the relay-agents (e.g. joint probability distribution of CSI), we use "contract theory" to design these 
set of contracts which are designed for different types of users (we will elaborate on "types" later on in 
this paper). Contract theory is a field of economics that studies how economic players or agents create 



mutually agreeable contracts or arrangements in presence of asymmetric or incomplete information [12| 



Contract-based solutions for spectrum sharing in wireless systems have recently been discussed in [131 



JT6J. The challenge behind contract-based approach for wireless systems is due to the fact that the agents 
can lie to principal about their individual information in order to increase their utility and hence a contract 
in this situation tries to create incentives for agents to report their information truthfully. 

Once the prospective relays confirm to the source which contracts (i.e. payments and SNRs) they are 
willing to accept for each subcarrier, the only problem that remains is to select appropriate relays in each 
subcarrier such that the overall capacity is maximized for the source under overall budget constraint. 
Without designing these contracts and having no information about exact channel conditions of the 
potential relays, it would be difficult for the source to optimally choose relays and offer them suitable 
renumeration. This is because relays can lie about their channel conditions and hence the source could 
possibly make inefficient payments with unsatisfactory performance. As we will see later in this paper, 
this relay selection now becomes a nonlinear non-separable convex knapsack problem which cannot be 
solved with reasonable computational complexity and we therefore suggest a heuristic method to solve it. 
We then compare the performance of our overall mechanism and heuristic relay selection solution with a 
simple relay selection scheme and show that not only the proposed solution performs better but also it is 



near optimal under most general settings. The proposed scheme is very simple to implement in practical 
systems, requires almost no information about relays at source, limits the computational overheads only 
at the source and requires very limited interaction with potential relays. 

A list of terms and definitions used in the paper is given in Table [1} The organization of the paper is as 
follows. We will first present our system model, problem description and solution approach in Section |II} 



The utility models for contract design will be discussed in Section [HI} In Section [TV] we will discuss a 
contract formulation under a complete or perfect information. In Section |VJ we will show how to obtain 
an optimal contract design under asymmetric information. Relay section under a budget constraint will 



be discussed in Section [VI} Numerical results will be presented in Section |VII| and conclusions will be 
drawn in Section IVIIIl 



TABLE I 
Terminology Used 



principal-agent model 


microeconomic model where payoff to the principal (source) depends on an 
action taken by the relay-agent and the bargaining power is kept with the 
principal. 


asymmetric information 


one party (relay-agent) has more or better information than the other 
(source). 


contract 


a tuple consisting of a targeted SNR that a relay of a certain type on a 
particular subcarrier can provide on that subcarrier, and a corresponding 
payment that the source promises to make to that relay. 


private information 


relay agent's instantaneous channel gains between relay-destination link on 
all subcarriers. 


type 


relay agents private information on a particular subcarrier, i.e., channel gain 
on a relay-destination link on that subcarrier. 


transfer 


payment made to a relay node by a source in lieu of a targeted SNR at 
destination. 


reservation utility 


minimum utility the relay-agent will get by not accepting a contract. 


incentive compatible 


relay-agent chooses the contract designed for his type only. 


individually rational 


contract designed for each type gives the relay-agent at least as much utility 
as it would get by not accepting the offer. 


revelation principle 


Every equilibrium outcome with a mechanism is realized by a payoff- 
equivalent revelation mechanism that has an equilibrium where the relay- 
agents truthfully report their types. 


single crossing property 


indifference curves for two different types of relay agents cannot intersect 
more than once. 


information rent 


positive surplus that the relay receives by accepting a contract. 
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II. System Model 

A. Problem Description 

We consider a typical cooperative network scenario in which a particular mobile node acting as a source, 
wants to transmit a block of data to a destination node with the help of some nearby mobile nodes that 
can act as relays. Fig. [T] shows an example of such a cooperative network system. We assume that the 
source uses an OFDM-based multi-carrier system for the transmission technology with a total number of 
TV subcarriers. We posit that there are M such mobile stations that could be the possible relay candidates. 
Based on its channel conditions, each relay node incurs a certain cost to provide a pre-specified SNR 
to the source on a particular subcarrier at the destination. Since there is no obligation for these mobile 
stations to forward its data towards the destination, the source mobile node must provide some incentives 
such as some monetary payment or credits, to these possible relay candidates. However, in such a system, 
it is practical to assume that the source is not only unaware of the number of possible relay candidates 
M but also the exact channel conditions on all the relay-destination links on each subcarrier. In absence 
of this information, the source doesn't know which relay nodes to choose and how much it should pay 
to each relaying node because relaying nodes are regular mobile users and are therefore selfish, and 
can potentially lie about their actual cost of transmission. The relay node's private information, i.e., 
instantaneous channel gains between relay-destination link on all subcarriers can be expressed as a vector 
*m = {^im, #2m, * * * @Nm}i where 9 im denotes the channel gain for the mth relay on the ith subcarrier 
for the corresponding relay-destination link. A relay node's channel gain on a relay-destination link on 
a particular subcarrier will henceforth be called its type on that subcarrier and we will subsequently 
use the symbol 6 without subscripts to indicate types in general. We assume these channel gains to be 
slow-varying, which means that they would remain constant for both transmission and relaying time slots. 

Although the source is unaware of relay node's exact type or channel condition, we assume that it 
has information about the joint distribution of the types and the set C M> from which these type 
vectors are drawn from. Moreover, we assume that source has a maximum budget T in one time frame 
for the total payments or transfers that it can make to the relay nodes over all subcarriers. We further 
assume that the source uses space-time coding for multi-relay transmission on the same subcarrier. Based 
on these assumptions, the problem can be described as follows: the source has to effectively choose a set 
of relays for every subcarrier in order to maximize its overall throughput in a given time frame, make 
optimal transfers to these relays without the knowledge of relays' private information, while making sure 
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Potential Relays 




Fig. 1. A typical cooperative wireless network system with user cooperation 

total transfers do not exceed the overall budget constraint T. 

B. Two Part Contract-based Solution 

This overall problem of selecting relays on each subcarrier while providing transfers to different relays 
is quite difficult to solve because of the overall budget constraint, multi-dimensional information types and 
information asymmetry (difference in available information between the source and the potential relays). 
However with the help of contract theory, we will attempt to solve it by breaking the problem down into 
two parts: 

1) Contract Design: A contract, is defined as a tuple consisting of a targeted SNR at destination on 
a certain subcarrier that a relay can provide and a corresponding guaranteed transfer or monetary 
incentive that source promises to make. The source first designs a set of common contracts applicable 
to all subcarriers without using any specific budget constraints, and broadcasts them to all relay 
candidates using some established protocol. The relays listen to the contracts offered by source then 
respond back identifying the contracts they are willing to accept for each subcarrier. 

2) Relay Selection: Based on the accepted contracts by the relays on each subcarrier, source then 
chooses an optimum set of relays for each subcarrier considering its budget constraint, while 
maximizing its expected capacity. We assume that the source instructs the selected relays with space- 
time-codes for each subcarrier, and hence in each subcarrier the overall SNR is the summation of 
SNRs provided by all selected relays. 
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Fig. [2] illustrates the complete representation of this mechanism in a three step process for a sample 
system. 




(a) Step 1: Source S broadcasts a set of (b) Step 2: Relays Ml, M2 and M3 accept (c) Step 3: Source selects relays Ml and 
contracts to all nearby relays Ml, M2, certain contracts on certain subcarriers M2, makes transfers, sends instructions 
M3, M4. and respond to source indicating which and messages, and relays help transmit to 

contracts they are willing to accept. destination D. 



Fig. 2. A contract based cooperative communication and relay selection mechanism 



III. Utility Models for Contract Design 

As we explained in section |II-B[ a contract is defined as a tuple consisting of a targeted SNR that 
a relay of a certain type on a particular subcarrier can provide on that subcarrier, and a corresponding 
payment that the source promises to make to that relay. For the purpose of contract design, we will focus 
our analysis for a general relay type 9 (channel gain 9 on the relay-destination link) on any subcarrier. 
To begin with, source first needs to design a set of common contract pairs (7(0), t{6)) for a given range 
of types 9 that are incentive compatible (IC) and individually rational (IR) on all subcarriers. Here, 7(0) 
is the SNR that the relay of type 9 can provide at the destination and t{9) is the transfer (e.g. monetary 
incentive) that the source node makes to the relay for a particular subcarrier. Incentive compatible means 
that the relay-agent chooses the contract designed for his type only. Individually rational means that the 
contract designed for each type gives the relay-agent at least as much utility as it would get by not 
accepting the offer or in other words, by not relaying. This minimum utility is also known as reservation 
utility and we will take it as in the rest of the paper. Using the revelation principle, we can focus our 
analysis on contract designs where agents declare their types truthfully or in other words, we can directly 
consider types while designing contracts [[12). We will now make a practical assumption that the relay 
nodes do not have a prior knowledge of source's budget T and the number of other relay candidates. In 
other words, the relay nodes have no way of knowing that whether the contract they will accept will be 



executed or not by the source. Assuming DF relaying with repetition coding, the SNR of the source-relay- 
destination link on a certain subcarrier will be given by mm{j S R, Jrd + 1sd}, where 7^ is source-relay 
SNR and j RD is relay-destination SNR JT7| |. Ignoring the direct path, the source-relay link can be safely 
assumed to be stronger, because source will only consider nearby mobile nodes as relay candidates and 
hence 7^ will be the bottleneck [13]. Therefore from now on, we will approximate j RD as the net SNR 
for the overall link and will drop the subscript and call it just 7 henceforth. 

We now define a quasi- separable utility for the source with a contract pair (7(0), t(0)) on each subcarrier 
as follows: 

u{-r{e))-t(e) (i) 

where U(-) is a concave function that gives the utility that the source gets with an SNR 7 between a 
relay and destination on some subcarrier, when it is using only this particular relay, and this utility can 
be given by Shannon capacity formula: 

^(7) = \ log 2 (1 + min{7<ra, 7 + j S d}) ~ \ log 2 (1 + 7) • ( 2 ) 

Here, the half factor is used to account for half duplexity of the relaying protocol and approximation is 
based on the argument in the previous paragraph. The overall utility of a relay candidate of type 6 that 
announces its type truthfully can also be described by a quasi- separable function given by the difference 
between transfers and cost of transmission: 

f(0)-C( 7 (0),0) (3) 

where £(7, 6) is the cost for relay of type 6 to provide SNR 7 at the destination on some subcarrier. This 
cost could be the summation of the cost of per unit power used for relaying in addition to fixed decoding 
costs. Ignoring the decoding costs, this cost can simply be given by: 

C(7,*) = y (4) 

where c is a positive number denoting cost per unit power and ^ is the transmitted power by the relay. 
Conveniently, since - §^p- < 0, the cost function satisfies a form of Spence-Mirrlees Condition or single 
crossing property [12]. What this means is that indifference curves (7,*) (plot of contracts for which 
a relay gets constant utility) for two different types of relay agents cannot intersect more than once. 
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Moreover, the economic significance of this condition is that the relay agents of higher types are willing 
to provide better SNR 7 for a smaller increase in transfer t. In the following sections, we will see how to 
solve the problem of contract design for two specific cases: complete information scenario and incomplete 
information scenario. 

IV. Contract Formulation with complete Information: First-best scenario 

This is the scenario when the source has the precise information of the relay types vector \l> m , i.e., CSI 
between relay-destination link in each subcarrier. This is also known as the first-best scenario and will be 
used for benchmarking, because this is the ideal case for source, as it is in the best position to make the 
maximum use of the available potential relays. Therefore in this scenario, source only has to ensure that 
each relay agent is ready to accept the contract that he is about to offer, or in other words he only has 
to satisfy relay-agent's individual rationality condition in each subcarrier. The source's objective problem 
for a relay-agent type of in a certain subcarrier can now be written as: 

max Z/( 7 (6>)) - t(9) (5) 
subject to t(6) - > 0. (6) 



The source hence gives the relay-agent zero utility in order to maximize its own utility, i.e., the source 
extracts all the surplus from the relay-agent. Therefore, setting ([6]) to equality, substituting in ([5]) and 
then differentiating the objective w.r.t 7 and finally equating it to zero, the optimal first-best contract 
(7(0), *(0)) for a relay of type is given by - 1, ^ " I )• 

V. Contract Formulation under Asymmetric Information: Second-best scenario 

A. Theoretical analysis with continuous relay-agent types 

In this section, we will analyze the structure of the solution using some standard theoretical analysis. 
In this case, we assume that the types of relays for all subcarriers are continuous and belong to a set 
© = [0? 0] an d has a joint probability distribution /(0i, 02, • • • 9 N ) (with F(0i, 2 , • • • 9 N ) as cumulative 
density function), which is known to the source node. Let V{9, 9) be the profit or utility achieved by relay 
agent of type on a certain subcarrier who announces his type as 0. The profit is given by the following 
function: 

v(e,0) = t(§)-c( 1 (§),0). (7) 
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The contract (7(6*), t(9)) satisfies the incentive constraints (IC) if and only if being truthful gives a relay 
node at least as much utility as it gets by lying, i.e., 

V(9,9)>V(6,6), V(M)e© 2 (IC). (8) 

Hence, for the contract to be incentive compatible, the following first and second order conditions must 
hold: 

[ dV(9,9) I 



:0 (Id) 

w € e, { u ° " " (9) 
Wl^<o dd). 



(86 \0 
d 2 V(6 

Substituting for V(9,0) 9 these conditions can be simplified to 

dt(0) cdrf{0) nr x 

vee e, < de ~ e de C 1} do) 

» > (id). 

This means that first both 7(0) and t{6) must be increasing in type 9 (by IC 2 ) and secondly, ICi tells us 
how the increase in transfers w.r.t to the agent types are related to increase in deliverable SNR. Let p(ff) 
denotes the utility of the relay agent of type 9 with the optimal truthful contract, i.e, a mechanism where 
relay chooses contract designed for his type only. Then, p{9) can simply be given by V(0, 9), i.e., 

p{o)=m- CJ f 1 - (id 



Using ICi, we can compute that 

dp = cry(9) 
d9 9 2 



(12) 



which is positive and implies that p{9) is an increasing function of 9 and hence the higher types benefit 
with higher returns. Assuming relay agent's reservation utility to be 0, its individual rationality (IR) 
condition can therefore simply be given by: 

p{9) = (IR). (13) 



This is because making transfers are costly to source node. Therefore using equations ( [TT] ), ( [12] ), and ( [13] ), 
we can write 



m = Zf + fZ&4r. (14 ) 
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Now the source's objective is to maximize the expected utility which is given as: 

r$ r N 



I I " I Y,( u Wn)) - t(e n ))f(e u 2 , • • • , e N )de 1 de 2 • • • <w N . (15) 



Substituting (14) in (15) and subsequently using integration by parts, we can rewrite source's optimization 



problem as follows: 



max 

7 (0) 



subject to IC 2 or > (i.e. 7 is increasing) 

dU 

and 7 > 0, (SNR must be positive) (16) 

where f n {6) is the marginal probability distribution and F n {9) is corresponding cumulative distribution 
of types in the nth subcarrier. The optimization problem in ( [T6| ) can be interpreted as follows: the source 
has to maximize the expression in the brackets of the objective function subject to the constraint that 
7(0) is positive and increasing in 0, where the first two terms of the objective are same as in the source's 
optimization problem under complete information scenario and the last term measures the impact of 
incentive problem. In order to solve the optimization problem in ( [T6| ), first we can just try to do pointwise 



maximization of the objective function at each 9. However, if pointwise maximization at each 9 in ( |T6| ) 
doesn't give us an increasing 7(0) function, then we can use resort to optimal control theory. 

Using this continuous case as a reference, we will now focus our analysis to the case where the types 
are considered to be discrete values rather than taken from a continuous set. This case is of more practical 
interest because the contracts can be easily broadcasted as finite number of values. In the next subsection, 
we will design incentive compatible contracts by approximating the continuous distribution by a discrete 
distribution with finite points. With the discussion above, we have a good idea about the structure of the 
optimal contract and we will notice some parallels when we discuss the discrete agent types case in the 
following subsection. 



B. Solution with discrete relay-agent types 

We will now see how to solve a more practical problem of designing contracts for relay agents with 
discrete types. This problem is more practical because the number of contracts are finite and can be 
transmitted to relay-agents in real-time. We quantize the set of types 6 = [0, 0] with a quantization factor 
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K such that the collection of types are reduced to a discrete set of K types, i.e., 6 = {S^ S 2 • • • S K }. 
Without loss of generality, we can assume that 5i < 5 2 < • • • < S K . We consider the quantization 
process to be uniform with equidistant values, i.e., S k = + ^(0 — 0), and if 6 is unbounded above, 
then could be replaced by the upper confidence limit of a desired confidence level. Using forward 
difference method, the probability that a relay-agent could be of type 5 k in nth subcarrier is given by 
7T k n = P(S k < n < S k+1 ) = F n (S k+1 ) - F n (S k ) (5 K+1 can be replaced by 0) with Ef=i^n = 1- We 
assume that source is aware of this distribution on all subcarriers. 

The objective of the source is to maximize its expected utility by designing an incentive compatible 
and individually rational optimal contract (7(5*?) (for simplicity, we will now refer it as {^ k) t k )) 

for each 5 k e 0, i.e., 

N N K 

ja^ E E n[uw)) - m\ = max E ^ n (u^ k ) - t k ). a?) 

n=l n=l /c=l 

The individual rationality condition for this discrete scenario can now be given by: 

f*-^>0, V4G6 (18) 
and the incentive compatibility condition is given by: 



tk-^^tj-^ vy^e. (19) 



Theorem 1: For the optimal solution, the individual rationality condition for the lowest type is binding, 
i.e., t\ — = and the others can be ignored. 



Proof: For any 5 fc e using the IC condition from equation (19) we can write that 



fc-^>t.-^>«.-^ (20) 

Ojfe Ofe ^1 

since ^ > ^i > and C7 > 0. Therefore, if IR for 5 X is inactive, so will be IR for S k . Hence, all the 
other IRs except for Su can be ignored. Now, if IR for Si is not binding, then all transfers t k s can be 
reduced by the same amount, having no effect on IC and hence increasing source's utility. ■ 
Theorem 2: For the optimal solution, < 71 < 72 < • • • < 7x, and all the downward adjacent ICs are 
binding and others can be ignored, i.e., 

f*-^=Vi-^=\ Vfc>2. (21) 
Ok o k 
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Proof: Proof is provided in Appendix. ■ 
Now using theorems [T] and [2j the optimization problem in ( fTT] ), ( [T8] ), and ( [T9| ) can be reduced to: 

N K 

max y^y^ 7r ^( c/ (^) -tk) 

71=1 /c = l 

c . , C71 _ C71 A 0(7, - 7^1) 

and < 71 < 72 < • • • < 7k. (22) 



Proposition 1: The optimization problem in ( [22] ) can be rewritten as follows: 

N K 

maX Kkn9n{lk) s.t. < 71 < 72 < • • • < 7k, (23) 

7feV/c z — ' f — f 
n=l /c=l 

where 



'f(T,)-?-e7 t (i- 5 i 7 )(^%^), Vk<K 
U( lk ) - if k = K. 



(24) 



Proof: Proof is provided in Appendix. ■ 
Now because of the concavity assumption on U(-) 9 this problem can easily be transformed into a simple 
convex optimization problem and can be solved using standard methods. In fact, it can be shown that the 
inequality constraint of increasing 7's can also be neglected, and hence point- wise maximization of each 
J2n=i 9n(lk) is sufficient here. Once we calculate contract pairs (7^, t k ) (k < K), it can be easily verified 
that a relay that has a type 9 in a certain subcarrier will automatically select contract /c, if S k < 9 < 5k+i, 
because this contract will maximize its utility. 

The objective of the contract design so far was to design incentive compatible and individually rational 
offers that the interested relay-agents can accept without revealing their types or channel information 
directly to the source. This helps the source to segregate the relays in terms of their abilities to deliver 
certain SNRs at the destination and the price at which they are willing to do so. Hence, the source can 
select relays based on his budget constraint and we discuss this relay selection problem and its solution 
in next section in detail. 



14 

VI. Relay Selection under a Budget constraint 

In this section, we will discuss the relay selection procedure for the source under the budget constraint 
with either complete or incomplete information. While in perfect information scenario, the source is 
aware of the contracts acceptable by each relay in each subcarrier, in case of imperfect information, 
source broadcasts the contract menu to all relays and each relay responds with a desired contract pair for 
each subcarrier as discussed in section [V] (if a certain relay is unwilling to relay in a certain subcarrier, we 
assume null contract (0,0) is acceptable). In either case, the source knows a contract pair (j mn ,t mn ) that 
is acceptable by relay m in the nth subcarrier. Under a budget constraint T, the objective of the source 
now becomes to maximize its total capacity. Let M = {1,2,..., M} denote the set of all the relay agents 
who are willing to relay while providing a certain SNR at destination in each subcarrier for a certain 
price that is determined by the contract for that relay agent. The objective is to obtain a subset vector 
S = {S n , Mn < N \S n C M} (i.e. set of selected relays in each subcarrier), 

maxC(S) 

N 

s.t. Yl l ™ - r 

n=l VraE<S n 

where, C(S) = ^ log 2 ( 1 + ^ 7mn j . (25) 

n=l \ VmG<S n / 

This problem is a nonlinear non-separable convex knapsack problem in its current form and it is difficult 
to find the exact solution JT8| ]. The standard method to obtain the optimal solution is to use branch 
and bound algorithm, where at each step, a series of continuous subproblems are solved to obtain upper 
bounds by integer relaxation of the original problem. The branch and bound algorithm is discussed in 
detail in JT9J. The authors in p0| ], pl| discuss methods to obtain these upper bounds for a general class 
of nonlinear non-separable knapsack problems. However, branch and bound method can still have the 
worst case complexity of exhaustive search and for M number of subcarriers and TV number of potential 
relays, the worst case complexity could be as high as 0(2 MN ), which makes the branch and bound method 
practically infeasible due to exponential complexity. In fact, we verified the complexity to be exponential 
in most cases for a very simple system with simulations. Due to lack of space and practical importance, 
we will not go into further detail of obtaining the exact solution. Instead, in the next subsection, we will 



propose a heuristic solution based on the structure of our original problem described in (25) 
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A. Heuristic Solution 

Here, we will discuss a few heuristics to solve the original problem by breaking it down in smaller 
problems that are standard 0-1 knapsack problems. We notice that if we divide the overall constraint T 
by allocating a budget constraint T n for subcarrier n, such that Yln=i 7~n = T, then the sub-problem for 
relay selection in subcarrier n is just a standard knapsack problem and can just be written as follows: 

max 7 mn s.t. t mn <T n - (26) 

Vra<E*S n VmeS n 

We also notice that the objective of the problem is to maximize the product n^ =1 (l + 5^ Vm€5 7 mri ), subject 
to the budget constraints. In order to maximize this product we need to maximize SNR ^ VmG<Sn 7 m7l for 
each subcarrier, while also making sure that none of the SNR's are too low, otherwise they will minimize 
the product. Based on this analogy, we will attempt to solve this problem using two forms of heuristics 
and we combine the results to obtain the final solution. 

The first heuristic is to decompose T into T n by using certain weights profile w n for subcarrier n and 
hence, T n could be given by T n = . The second heuristic will be to sequentially select relays for 

each subcarrier as long as we are under the budget constraint. We suggest three weight profiles for the 
first heuristic as follows: 

1) Equal subcarrier weights (ESW): The simplest possible way is to choose equal weights for all 
subcarriers: 

w™ = l, Vn. (27) 

One simple way to measure two different contracts relative to each other is to compare how much is the 
SNR per unit price for each contract. This metric, i.e., SNR per unit price, can be defined as the efficiency 
and can be used to compare the subcarriers relative to each other either by averaging the efficiencies of 
contracts in each subcarrier or by calculating net efficiency in each subcarrier. The following weight 
profiles are based on this observation: 

2) Average subcarrier efficiency weights (ASW): If the efficiency of a contract accepted by relay m 
in subcarrier n is given by e mn = then the weights w n of nth subcarrier are obtained by the 
following relation: 



w {2) = ^m=i e mn ^ ^ (2g) 



3) Net subcarrier efficiency weights (NSW): In this case, weights are obtained by calculating the 
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net efficiency of a subcarrier, i.e., the ratio of maximum achievable SNR and the corresponding 
maximum transfer: 



w 



(3) 



T M t 



, Vn. 



(29) 



Using each of the three above mentioned weight profiles, we solve the original problem iteratively by 
solving TV standard 0-1 type knapsack problems. These knapsack problems can be solved using dynamic 
programming by scaling and rounding transfers t mn and budget T n [22]. For each of the above mentioned 
weight profiles, we obtain solution subset vectors S^, S^ 2 ^ and S^ 3 ^ for each subcarrier. For the second 
heuristic solution, we perform an efficiency based relay selection as follows: 

4) Sequential Subcarrier Contract Pair Allocation (SCPSA): In this heuristic, we allocate a relay to 
each subcarrier sequentially by choosing a relay that provides greatest efficiency e mn and has not 
been allocated in that subcarrier. We repeat this process until we run out of T and we obtain the 
corresponding solution subset vector and call it 
The overall heuristic solution is hence chosen as the solution vector that gives highest capacity, i.e., 



S = arg max |C(S W )}. 

S(0|i=l,2,3,4 



(30) 



TABLE II 
List of Heuristics 



Heuristic Method 


Description 


Solution Subset Vector 


ESW 


Divide T based on weight profiles 
= 1, Vn and solve N 0-1 
knapsack problems 


S (D 


ASW 


Divide T based on weight profiles 

w { n ] = E ^ emn , Vn and solve N 
0-1 knapsack problems 


S (2) 


NSW 


Divide T based on weight profiles 


S (3) 




wi 3) = S =l7mn , Vn and solve N 
0-1 knapsack problems 








SCPCA 


Sequential Allocation per subcar- 
rier as per maximum efficiency 




Overall Heuristic 


Combination of ESW, ASW, NSW 


S = argmax s(i )| i=1)2) 3,4{C(S«)}. 




and SCPCA 



Table [XT] summarizes the overall heuristic solution and Algorithm [T] describes the entire relay selection 
heuristic. The net complexity of the algorithm can be calculated as follows: The SCPSA heuristic is just 
sorting and selecting MN contract pairs, hence the complexity can be 0(MA^log(MA^)). The three other 
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heuristics based on weight profiles solve TV knapsack problems, each upper bounded by pseudo polynomial 
complexity of O(MT) (assuming T is rounded). Hence the overall complexity will be O(MNT), which 
is much easier to handle than branch and bound algorithm for small to medium values of budget constraint. 



Algorithm 1 Relay Selection Algorithm 



for i = 1 to 4 do 

Set S$ = (/),\/n < N 



if i < 3 then Obtain weights w$ by (|27|), (|28j) or (|29j) for i 
Set T n = v$TI En=i ™n\Vn < N 
for n = 1 to TV do 
Set r = T n 
for t = to T n do 

r[0,t] = 
end for 

for m = 1 to M do 
for t = to T n do 

if tmn < t and T[m - 1, t - t mn ] + 7 mn > T[m - 1, t] then 



1, 2, 3 respectively Vn < N. 



r[m, t] r[m 



*mn] +7mn, s[m,t] = 1 



else 



r[m, t] = r[m - 1, t], s[m, t] = 
end if 
end for 
end for 

for m = M to 1 do 

if s[m, r] = 1 then := S$ U {m}, r = r — t Ti 
end if 
end for 
end for 
else if i = 4 then 
while T > do 

for n = 1 to TV do 

m = argmax Vm ^(i){7 mn /t mn }, T = T - t mn 

if T > then 5^ := U {m} 
end if 
end for 
end while 
end if 

Set S^ = {S ( i i \s¥ ) '- 
end for 

return S as given by ( [30] ) 



4 } > 



VII. Numerical results 

In this section, we will briefly present some of the numerical results. For simulations, we consider 
a system where the relay types 9 are normalized, independent and uniformly distributed between 50 to 
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300 in each subcarrier. Types less than 50 are assumed to be of no interest for the source so they are 
are considered. Other distributions or particular fading models can be considered too but for simplicity 
we use uniform distribution for our simulations. As a first step to generate a set of first and second 
best contracts, we quantize the range of types with a quantization factor K to be 10. The number of 
subcarriers TV is chosen to be 16 and the parameter c is taken to be unity. The simulation parameters and 



the corresponding first and second-best contracts are presented in Table [HI} The first-best contracts are 
calculated when the source is completely aware of the relay-agent's discrete type (complete information). 
However, the first-best contracts are not incentive compatible (downward ICs do not hold) and it can 
be easily verified by plugging the parameters of Table [III] in relay-agent's overall utility. On the other 
hand, the second-best contracts are incentive compatible by virtue of design. The IC conditions can be 
verified with the corresponding second-best contracts, i.e., any relay of type 6 s.t. Sk < < 5k+i will 
automatically pick the kth contract, because this contract will maximize its expected utility. Another 
noticeable difference between the first and second-best contract that can be seen from Table [1111 is that 
under incomplete information, except for the lowest type, the source pays more to get a certain SNR than 
what it would have gotten for less price with complete information. Moreover, source asks for sub-efficient 
SNRs from all types except the highest type. This is done so in order to provide incentive for higher types 
to not to choose a lower types' contract, and the related concept is called information rent p3]]. In simple 



words, information rent is the positive surplus that the relay receives and Table [III] clearly indicates that 
higher type relay gets more positive surplus for the contract designed for its type. 



TABLE III 
First and Second Best Contracts 





Relay types 




First-best contract 


Second-best contract 


Information Rent 




& distribution 


(7 (1) ,£ (1) ) (7 in dB) 


(7 (2) ,t (2) ) (7 in dB) 


tm-crym/o 


Si 


= 50, ir ln = 


0.1 


(15.4490,0.7013) 


(9.0401,0.1603) 







= 75, 7T 2n = 


0.1 


(17.2510,0.7080) 


(12.3131,0.2806) 


0.0534 


5 3 


= 100, 7T 3n = 


0.1 


(18.5208,0.7113) 


(14.6324,0.4008) 


0.1102 


5 3 


= 125, 7T 4n = 


0.1 


(19.5021,0.7133) 


(16.4428,0.5210) 


0.1683 


5 3 


= 150, 7T 5n = 


0.1 


(20.3020,0.7147) 


(17.9322,0.6412) 


0.2271 


5 3 


= 175,7T 6n = 


0.1 


(20.9773,0.7156) 


(19.1990,0.7615) 


0.2863 


5 3 


= 200,7T 7n = 


0.1 


(21.5615,0.7163) 


(20.3020,0.8817) 


0.3457 


5 3 


= 225, 7l 8n = 


0.1 


(22.0764,0.7169) 


(21.2794,1.0019) 


0.4052 


5 3 


= 250, 7r 9n = 


0.1 


(22.5367,0.7173) 


(22.1564,1.1221) 


0.4649 


5 3 


= 275, 7Ti0n = 


= 0.1 


(22.9528,0.7177) 


(22.9528,1.2424) 


0.5246 



Next, we will evaluate the performance of four heuristics, namely ESW, ASW, NSW, SCPSA, that we 
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suggested in section |VI-A| with respect to each other and a few benchmarks we will describe here. We 
compare the performance of these heuristics with the obvious simple solution, i.e., select the contracts 
that offer the best SNRs amongst all contracts for all subcarriers while satisfying the budget constraint. 
Moreover, we will also compare the performance of the proposed heuristics with respect to the solution 



of original problem in ( |25| ) with relaxed integer constraints as a benchmark. We will call these solutions 
as "Best SNR contracts" and "Relaxed Solution" respectively in the corresponding plots. In Figures [3} 
|4j and [5} we plot average capacity per subcarrier vs number of relay agents for three values of T, i.e., 8, 
16 and 24 respectively. The number of subcarriers TV are fixed at 16 and quantization factor K is chosen 
to be 10. As we could notice from these plots, the heuristic SCPSA always performs better when there 
are fewer relay agents. The three other heuristics based on weight profiles, namely ESW, ASW and NSW 
have a very similar performance and perform better than SCPSA when number of relay agents are high 
and budget is not very high. Moreover, "Best SNR Contracts" solution not only has inferior performance 
compared to proposed heuristics in general, but the average capacity with this solution decreases as the 
number of relay agents increase. In addition to this, the gap between the envelope of proposed heuristics 
(overall heuristic solution) and "Relaxed Solution" decreases as T is increased. Notice that the optimal 
solution lies in between this gap, hence, smaller this gap is, better is the performance. Additionally, we 
notice that for the overall proposed heuristic, capacity tends to converge to a stable value as number of 
relay agents are increased. The convergence happens because of the diversification of independent relay 
types. 

Fig. [6] compares the performance of the proposed heuristic, i.e., overall average capacity with respect 
to number of subcarriers for two values of budget constraints. The simulation parameters are provided 
under the figure. We could easily deduce from this figure that the performance of "Best SNR Contracts" 
saturates very quickly and is far inferior from the proposed heuristic solution because of lower overall 
average capacity. One reason why "Best SNR Contracts" has inferior performance is that in this solution 
the best SNRs may not be well-spread over all subcarriers and some of the subcarriers may be underused. 

In Fig. [7} we plot the average capacity per subcarrier vs. quantization factor for the heuristic solution and 
for the "Best SNR Contracts" solution with two different budget constraints. Once again, the parameters 
are provided underneath the graph. It is interesting to observe that the average capacity per subcarrier 
for the proposed heuristic solution remains almost unperturbed as we increase the quantization factor K, 
which means that it is not necessary to quantize the probability distribution to a very high factor in order 
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-v — -v v v v v — v v — v v 



ESW 
ASW 
NSW 
SCPSA 

Best SNR Contracts 
Relaxed Solution 



10 12 14 

Number of Relay Agents (M) 



Fig. 3. Comparison of different heuristics with T = 8, iV = 16, and K — 10 




10 12 14 

Number of Relay Agents (M) 



Fig. 4. Comparison of different heuristics with T — 16, N = 16, and K — 10 



to obtain better performance. For example, a quantization factor as low as 3 which essentially classifies 
the types as "good", "average", or "bad" will suffice. However, this result is for uniform distribution and 
care should be taken for any other kinds of probability distribution (e.g. Rayleigh) for which the results 
could vary because for a non-uniform distribution, higher quantization factor may lead to some types 
more probable than others. 

Lastly, we will analyze the performance of our system under both complete and incomplete information 
scenarios. In order to do that, we plot average capacity per subcarrier vs. the number of relay agents for two 
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2 4 6 8 10 12 14 16 18 20 

Number of Relay Agents (M) 



Fig. 5. Comparison of different heuristics with T = 24, N = 16, and if = 10 



200 r 




,1 1 1 1 1 1 1 1 

5 10 15 20 25 30 35 

Number of Subcarriers 



Fig. 6. Capacity vs. number of subcarriers (N) for fixed M = 10, and K = 10 and two values of T = 16, 24 



values of budget constraints under these two scenarios in Fig.[8j We use heuristic solution for relay selection 
to evaluate the capacity. For each budget constraint, we plot the case where we have complete information, 
i.e., source knows the efficient contracts for all relays, and for incomplete information we plot two cases; 
when first-best contracts are broadcasted, and when second-best contracts are broadcasted. As expected, 
on average, for each budget constraint, the performance gap due to information asymmetry between the 
complete information and the incomplete information with the second-best contracts is smaller than gap 
between complete information and the incomplete information with the first-best contracts. Moreover, the 
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v 1 1 " 1 1 " 1 1 

23456789 10 
Quantization Factor (K) 

Fig. 7. Average Capacity vs. Quantization Factor (K) for fixed N = 16, M = 10 and two values of T = 16, 24 



9r 




J I 1 1 1 1 1 1 1 1 1 

2 4 6 8 10 12 14 16 18 20 

Number of relay agents (M) 



Fig. 8. Comparison of first best and second-best contracts, and full information scenario with N = 16, K = 10, and two values of 

T=8,24 



capacity obtained with the first-best contracts is almost always constant because the first-best contracts 
are not designed to be incentive compatible and only the smallest contract is selected by all relays, so 
increasing the number of agents has no effect on performance. 



23 

VIII. Conclusion 

In this paper, we studied the problem of relay selection and incentive mechanisms in multi-carrier 
wireless systems under asymmetric information. In such networks, a source node is assumed to be ill- 
informed of possible potential relay nodes and their private information such as channel conditions on the 
relay-destination link. This information asymmetry makes it harder for the source to choose selfish relay 
nodes efficiently and hence to optimize its throughput. In this paper, we addressed this classical problem 
by introducing a simple principal-agent model for source and relays. The advantage of this model is that 
it leaves the bargaining power completely to the principal which in our case is the source node, and this 
reduces signalling and computational overheads for the relays. We then divided the problem into two 
parts. In the first part, we used contract theory to design a common incentive compatible contracts for 
the relays (assuming that source has a joint distribution of private information or types of relays for all 
subcarriers), i.e., a relay of a certain type will choose contract designed for his type only. These contracts 
are broadcasted by the source to all relays and the interested relay-agents respond with the contracts they 
are willing to accept in each subcarrier. Once the source becomes aware of these contracts, the only problem 
that remains is to select appropriate relays in each subcarrier such that the overall capacity of source is 
maximized while the source is under a budget constraint. We formulated this problem of relay selection as 
a nonlinear non-separable knapsack problem and suggested a heuristic solution to solve it efficiently. The 
source then notifies the selected relays with instructions such as space-time codes and makes the required 
transfers. We compared the performance of heuristic solution with a simple relay selection mechanism, 
presented numerical results and showed that our solution performs better under the most common settings. 
The overall mechanism introduced in this paper is simple and has limited interaction between the source 
and the potential relays and participation of interested nodes is also voluntary. Future work will address 
more complex issues such as energy efficiency and power control j24), effect of direct link and when to 
relay |25j, and designing improved heuristics and protocols. 

Appendix 

A. Proof of Theorem [2] 

Let us consider two relay-agent types Sk and Sj such that 5 k > Sj. The mutual IC conditions for these 
relay types are 
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5 3 



>t k 



(32) 



Adding these two IC conditions gives 



cryj < 07^ C7 fe 
or, ^-(7* - jj) < S k (j k - jj). 



(33) 



Since S k > 5j 9 we can say that ^ k > jj. And because 7's are all assumed to be positive, we have 



< 71 < 72 < • • • < Ik- 



(34) 



So, we proved the first result and now we must also prove that for the optimal solution, ICs reduce to 



(21 ) when compounded with (34). This proof is a slightly more intricate but we will first prove that when 
the downward adjacent ICs are binding, i.e., ( [2T] ) is true, all the other ICs are automatically satisfied 
(sufficiency) and we will then prove that when one or more downward adjacent ICs is not binding, the 
contract cannot be optimal and a better contract can be obtained by binding the downward adjacent ICs 
recursively by reducing the transfers, hence increasing the source's utility (necessity). 



1 ) Proof of Sufficiency: Suppose the adjacent downward ICs are binding, then we can rewrite ( [21] ) as 
follows: 

(35) 



(+ + \ c (7fc ~ lk-i) w , 



Lets consider some j such that j > k, then using (34) and (35), we can write 



(tj — tk) — (tj — tj-i) + (tj-i — tj-2) + • • • + (tjfe+i — tk) 

c( 7i - 7^!) c( 7j _! - 7i _ 2 ) _ _ _ c(7 fc+1 - 7fc ) 



S 3 



6j-i 



< c(7j ~ 7j-i) + c(7j_i - 7i-2) , c(7 fc+ i - 7 fc ) 



4 

c(7i - 7fc) 



4 



4 



(36) 



Now, lets take some j such that j < k, then using (34) and (35), we can write: 



(tk — tj) — (tk — tk-i) + (tk-i — tk-2) + • • • + (tj+i — tj) 

c (7j+i - 7i) 



c(7fc ~ 7fc-i) + c(7fc_i - 7/C-2) 

4 4-i 



4- 
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> c(7 fc - 7fc_i) c(7 fc _i - 7 fc _ 2 ) c(7 i+ i - jj) 
Sk S k S k 



(37) 



Combining equations (36) and (37), we get: 



(h - tj) > c(7fc lj) or t k - ^ > - ^, Vj^- (38) 



Hence all the ICs are automatically satisfied when adjacent downward ICs are binding. 

2) Proof of Necessity : Suppose one or more downward adjacent ICs are not binding for optimal solution 
(and IRs are satisfied because it is a solution). Lets take one such type S k for which adjacent downward 
IC is inactive, so using IR for type S k _i we have: 

t k ~ > " CJJ F^ ^ " ^ ^> Kj < k (39) 

Ok Ok Ok-l 

What this means is that if we reduce all i/s, Vj > with equal amount through which the adjacent 
downward IC for type 5 k becomes active, it will not affect any of the IRs and the existing relation 
(whether binding or not binding) between adjacent downward ICs for every other type. We can iteratively 
repeat the process (starting with the lowest type for which adjacent downward IC is inactive) till all 
the adjacent downward ICs are binding. In this process, we have only reduced the transfers to bind all 
the downward adjacent ICs, which in turn automatically guarantees that all the other ICs are satisfied 
from the sufficiency conditions proved in Part 1. This therefore increases source's profit because transfers 
are expensive for the source. Hence, the original contract cannot be optimal because we found a better 
contract, which is a contradiction. 

B. Proof of Proposition^ 

Lets look at the second term J2n=i^k=i n kntk of the objective of optimization problem in (22). 



Substituting the equality constraints from ( |22| ), we write the individual terms of the summation as follows: 

N N / 

Klnh = y^TTln f 

77=1 71=1 ^ 

N N 

^ ^2nh = K 2Ti 

77=1 77=1 

N N 

VV^ / c 7i , C l2 CTfi , C73 C7 2 



C7i 
5i 


) 




C71 
Si 


C7 2 

s 2 


C71 

s 2 


C71 


C72 


C71 
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N 



N 



7^ 



n=l 



n=l 



C71 C72 C71 C73 C72 



*1 



+ 



+ 



C7x c7k-i 



Now adding the above equations, collecting the terms for each and using the fact that Y^f=i 71 'in = 1 
we can derive the following : 



N K 



n=l k=l 



N K 



N K 



^ ^ 7T/cn4 = C7i 



n=l ?'=1 n=l ?'=2 

AT K N K 



N K 



Si 



H C7 fc 

K-i 



1 in e 
\ / _ / ^ " in \ 



7I"m + 



z n=l ?;=2 d n=l z=3 / 

AT 



4 

^ E ^knC^fk 



k=l 
N K-l 



n=l k=l 



n=l i=k n=l i=k+l 

N K N K 

n=l i=k 

4 \ TTfcr 



E c ^MrEE^-^-E E ^-j+E 

/c+i n =l i=]fe+l 



71=1 

1 

^+i 



77=1 



N 

£ 

77=1 



c7k 



(41) 
(42) 
(43) 



Substituting back in (22), we get (24). Hence, the proof is complete. 
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